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Abstract —In this work, we have developed a robust lane 
detection and departure warning technique. Our system is 
based on single camera sensor. For lane detection a modified 
Inverse Perspective Mapping using only a few extrinsic camera 
parameters and illuminant Invariant techniques is used. Lane 
markings are represented using a combination of 2nd and 4th 
order steerable filters, robust to shadowing. Effect of shadowing 
and extra sun light are removed using Lab color space, and 
illuminant invariant representation. Lanes are assumed to be 
cubic curves and fitted using robust RANSAC. This method 
can reliably detect lanes of the road and its boundary. This 
method has been experimented in Indian road conditions under 
different challenging situations and the result obtained were 
very good. For lane departure angle an optical flow based 
method were used. 

I. INTRODUCTION 

With the increasing number of vital life loses in accidents, 
India is one of the most accident prone country, where 
according to the NCRB report 135,000 died in 2013 and 
property damage of $ 20 billion [1]. Many a time, accidents 
and unusual traffic congestion take place due to careless and 
impatient nature of drivers. In most cases drivers don’t follow 
lane rules, traffic rules leading to traffic congestion and ac¬ 
cidents. For counter measuring all these problems, advanced 
driver assistance system is needed that can assist people drive 
safely or drive itself safely in case of autonomous driving 
cars. It is quite a challenge to make autonomous car that can 
self-sense the environment and drive like an aware human. In 
some recent works researchers have developed autonomous 
car, even though its not still deployable in real life. 

In developed countries such as U.S.A and Germany, with 
the gradual emergence of autonomous driving research, ef¬ 
forts are on to build a smart driving system that can drive 
more safely without any fatigue, as compared to humans 
can be programmed to follow traffic rules. In this context 
the main challenge involves understanding complex traffic 
patterns and taking real time decision on the basis of visual 
data from camera and laser sensors. For these automatic 
cars, modelling vehicle current lane with respect to the road 
environment is very relevant for accurate driving, maintain¬ 
ing correct lane and keeping track of front vehicles. Apart 
from this estimating departure angle from the current lane 
for possible overtaking and taking turn in curved road is 
also important. Fig. [T] shows a sample vehicle lane detection 
scenario. 
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Fig. 1: Vehicle lane detection scenarios 


Whether automatic cars will become a future reality or not, 
Advanced Driver Assistance Systems (ADAS) are increas¬ 
ingly deployed in modern cars. Road lane, road boundary 
and departure angle estimation are crucial modules of ADAS. 
Such modules facilitate and validate human judgment. They 
can also be used to prepare the automobile in case of an 
emergency situation. 

In this work, we have developed a robust lane detection 
system using a modified Inverse Perspective Mapping (IPM) 
algorithm where camera intrinsic parameters are not re¬ 
quired. This IPM formulation can give up to 45m of accurate 
road view. By using IPM a wide area of unwanted region is 
removed and this will help to locate lane features accurately. 
Also a novel lane departure warning system is developed. In 
addition to that another contribution of our method is that 
it can detect road boundary lane even if there are no lane 
marking, suitable for developing countries context. For this 
purpose wide angle camera sensor mounted on car roof was 
used to capture surrounding road environment. 

Rest of the paper is organised as follows, Section II 
describes related literature. In Section III elaborate detection 
of lane and computation of departure angle method, and in 
Section IV our experimental setup. Finally we conclude in 
Section V. 

II. Related Work 

The related literature on autonomous driving and advanced 
driving assistance system are based on using single or mul¬ 
tiple camera facing the road to detect lane feature. Sensors 
specifically LIDAR, RADAR etc. are used for detecting 
object and 3D modelling of the road environment. Also in 


some works driver behaviour understanding using a camera 
facing the driver is used for drowsiness, sleepiness, and 
fatigue detection. 

For lane detection and departure warning system many 
works target urban and countryside area [2],[3], [4], [5], [ 6 ], 

[7] . Most of these works have used Image Processing and 
Machine Learning based approach for defining and extracting 
features for lanes. Some of the works have straight and 
planer road assumption and only works in highway. This 
happens because of assumption of strong lane marking and 
low traffics. In lane tracking kalman filter and particle filter 

[ 8 ] based approach is used. Another work based on vanishing 
point detection [9] gives a good result in countryside road. 

Other related works include methods for road segmenta¬ 
tion, traffic signs detection and recognition, 3D modelling of 
road environment (e.g. [10],[13],[14]). Parallax flow compu¬ 
tation was used by Baehring et al. for detecting overtaking 
and close cutting vehicles [11]. For detecting and avoiding 
Collison, Hong et al. had used Radar, LIDAR, camera and 
omnidirectional camera respectively [12], [16]. They focused 
on detecting using LIDAR sensor data classifying object 
as static and dynamic and tracking using extended Kalman 
filter and for getting a wide view of surrounding situation. 
For detection of forward collision Srinivasa et al. have used 
forward looking camera and radar data [13]. 

In some works driver behaviour and inattentiveness was 
modelled using fatigue detection, drowsiness, eye tracking, 
visual analysis etc. Ji et al. [17] presented tracking method 
for eye, gaze and face pose and Hu et al. [18] used SVM 
based method for driver drowsiness detection. Driver be¬ 
havior was modelled using visual analysis of surrounding 
environment in our previous work [15]. 

III. Our approach 

We summarize our system in Fig. [2j as to how we estimate 
road lanes, road boundary and departure angle. 

A. Lane detection 

For localising vehicle on the road estimation of some 
related parameters like its current lane, shape of the road 
and its position from centreline. To compute this parameters 
the road environment is scanned using wide angle camera 
sensor and extract lane markers. For lane detection we have 
proposed a novel method using Lab colour space, 2nd and 
4th order steerable filters and improved Inverse Perspective 
Mapping. Below our lane markers extraction algorithm is 
described. 

Al. Perspective effect 

In real world situation if two parallel lines are captured 
they appears to be converged to some distant points so their 
nature can’t be understood in images. Road lanes are parallel, 
for detecting and localising them in images the effect of 
perspective projection is removed using Inverse Perspective 
Projection. In this work we have presented a modified version 
of IPM, which is robust to a distance of 45m. No internal 
parameter calibration of camera is required for computation 
in comparison to other algorithm [2], [14]. Suppose Camera 



Fig. 2: Overview of Method 


location with respect to car coordinates system (Cx,Cy,Cz) 
where Cz will be the height from ground lane ’h’. Optical 
axis make an angle 0 known as pitch angle, 7 yaw angle and 
a as half of camera aperture as shown in Fig. [3] 
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To increase computational speed removing uninterested 
area from image we define horizon line from where our 
interested area will lie below ’’Horizon Limit” as shown in 
Fig. [4] After applying this horizon limit, inverse perspective 
mapping will be applied to this modified image. 

For derivation of IPM road is assumed to be perfectly 
planer. Because of this assumption different type of obstacles 
present in the road which does not lie in the road are 
deformed and seen as some noisy area in IPM image. Denote 
image coordinates as ( Ix,Iy ) and real world coordinates 
as (x,y,0). Suppose camera resolution as m x n, then 
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Fig. 4: Area of interest 


the following image to world frame mapping equation is 
obtained from derivation 
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A3. Cubic Interpolation and RANSAC 
RANSAC method was used for identifying and getting po¬ 
tential lane points position from extracted features points for 
fitting a parabolic curves. RANSAC is an iterative algorithm, 
it removes outliers and fit defined model to data point. 
Maximum of 8 curves (lane lines) can be identified by using 
this proposed method. In most of the roads except centre lane 
other lines are discontinuous, to get continuous edge to fit a 
polynomial in those plain areas cubic interpolation are very 
efficient. Cubic interpolation used in these setup depends on 
gradient value and direction. Our road model is given in Eq. 
(11), where yo is offset from vertical coordinate system and 
a,5,c are lane parameters . 


where hz represent start row of image of interest. 

A2. Feature Extraction 

For detecting lines and curves, 2D steerable filters [19] are 
very effective to use, because gradient changes due to color 
variation of road and lanes is effectively captured. In addition 
to that, due to their separability nature, computation is faster 
than other filters. The result obtained from both 2nd and 4th 
order filters are combined to extract final lane markings on 
the basis of adaptive thresholding, this depends also values 
of gradient angle to supress edge in unwanted direction. In 
Fig. [5] filters used in this method is shown. Filter kernel used 
are represented by Eq. (6) to (10). 



2nd Order filter kernel 



4th Order filter kernel 

Fig. 5: Response at 0,45 and 90 degree 


Y = y 0 + aX + bX 2 + cX 3 . (11) 

B. Road Boundary Lane 

Only lane line extraction can’t give an overall idea about 
car position if road boundaries are not known. Most of the 
time road lane boundary are not so clear and even not paved 
mainly in Indian situation, to cope up with this we need 
to segment the road area. For this 3 class based Gaussian 
mixture model was used for segmentation of the road region. 
Since IPM image’s majority pixels are road part and cars and 
other obstacles present in the road area becomes noise in the 
IPM image, so GMM can be used efficiently for this task. 
Method is applied in illuminant invariant 45m accurate IPM 
image, this method perform efficiently for this purpose. 

Three clusters used for segmentation comprise of road 
region, surrounding natural scenes and road obstacles. Prede¬ 
fined mean and covariance values for our clusters was used. 
For computation of these initial means and covariance, we 
collected separate patches from train images for these three 
categories and computed those values. This initialization 
gives us better result than random k means initialization. An 
iterative expectation maximization based algorithm is used 
to compute final means, covariance and probability of each 
clusters in GMM. 

At the end a Bayesian classification techniques Eq. (12) 
is used to classify each pixels in image. 
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Here q denotes a class i, m Ci means and a Ci variances and 
prior probability p(ci) of the class. 

Using vanishing point estimation rest of the road boundary 
beyond 45m of images, which is not covered in IPM image 
can be approximately modelled [9]. 

C. Lane Departure Angle 

To avoid potential risk of accident or hazardous driving 
and maintaining proper lane, departure warning is very 
important. Using information from current position of vehicle 
with respect to lane specifically offset and optical flow 
computation this angle can be approximately computed [20]. 
Horizontal optical flow is a strong feature for knowing 
its unwanted horizontal velocity, which may be a clear 
indication of lane changing or overtaking, except the case for 
curved road region. Fig. [6] and Fig. [7] illustrate the concept. 

A = arctan( —) (13) 



Fig. 6: Lane Deperture angle Idea 



Fig. 7: Lane Deperture warning from optical flow 


IV. EXPERIMENTAL RESULTS 

This proposed method has been experimented using dif¬ 
ferent challenging datasets to analyze the performance and 
reliability. Experimentation on image sizes of 440 x 680 
and 375 x 1242 obtained from video of moving camera in 
different road environment were carried out. This system was 
developed using C++ language in LINUX intel quad core 
il machine. We have collected a dataset in Bangalore city 
road condition, with a wide angle camera sensor mounted on 
our test vehicle’s roof at height 155cm from ground plane 


at speed of around 45km/h pointing towards the forward 
road plane at an angle of 3° from horizontal line, for 
testing our algorithm accuracy in Indian condition. This 
dataset contains frames with varying luminance, shadows, 
curved lane lines and road without boundary lane lines. Also 
standard datasets KITTI [21] and Caltech [14] was used for 
checking this algorithm in broad regions. These two datasets 
contain images with different condition like, sunny road with 
shadow, urban road with traffic and highway etc. 

With the combination of 2nd and 4th order steerable filters 
to detect edge in horizontal direction and vertical direction, 
results in the reduction of extra outliers, which help in 
robust fitting of lane lines and better input features to main 
RANSAC outliers removal and fitting lane lines. In addition 
to that horizontal lines on the road are associated with the 
detection of pedestrian crossing. This method is also capa¬ 
ble of generating pedestrian crossing warning by detecting 
lines in horizontal direction. First row of Fig. [8] shows the 
original images from KITTI dataset and second row depicts 
corresponding IPM image overlaid with extracted possible 
features points. In Fig. [9] first row depicts the IPM images 
of indian road dataset and their corresponding final lane 
markings obtained after applying the algorithm is shown in 
second row. This method can detect road boundary even if 
there are no boundary lane marking, which is very useful 
for Indian road conditions. From Fig. [8] it can be seen that 
this method does not make any assumption of straight road, 
can detect lane features even if road is not straight. We have 
tested our algorithm in Indian road condition and obtained 
acceptable accuracy, also it can detect road boundary very 
well and the road region in road where there are no lane 
marking exist. 

We have observed that using illuminant invariance tech¬ 
niques, separating luminance and colour parts of image gives 
better accuracy over normal RGB images for better detection 
of lane lines. This setting are useful for various illumination 
changes due to shadows, raining, fogs etc. 

In Table 1 we have given an analysis of precision (correct 
rate), false positive and correct boundary, obtained in lane 
detection and road boundary detection in three dataset. Pixel 
wise evaluation was used for the computation of these 
parameters. Lane detection and road boundary detection are 
building blocks for better accuracy of this method. Also 
robustness due to lack of boundary lane and shadow can be 
observed in Fig. [9] A comprehensive result with comparisons 
with existing state-of-the-art methods were shown in Table 
2, this analysis was carried out in KITTI dataset. It can be 
seen that precision of our lane detection method at 40m range 
outperform other existing methods. 


PRE = 


TP 

TP+ FP 


(14) 


Where TP is true positive and FP is false positive. Also 
PRE-20, PRE-30 and PRE-40 are precision in 20m, 30m 
and 40m of IPM image respectively. This precision measure 
with respect to distance are important are important for lane 
detection efficiency and depends on IPM image computation. 





































Fig. 8: Image, IPM view and extracted lane features in KITTI dataset 



Fig. 9: IPM image and detected lanes in indian road 


TABLE I: CorrectRate of ego-lane evaluation(upto 45m) and Road Boundary Detection 


Database #Frame #detectedAll 

#Boundary 

CorrectRate 

False Positive 

CorrectBoundary 

KITTI 

600 

565 

591 

94.26 % 

6.79 % 

98.44 % 

Caltech 

1224 

1189 

1204 

97.14 % 

4.17% 

98.36 % 

Indian Road 

1200 

• 1087 

1131 

90.58 % 

12.37% 

94.25 % 



TABLE II: Comparison with other Methods in KITTI dataset 


Method 


PRE-20 PRE-30 

PRE-40 

Runtime 

Environment 

SPRAY [22] 


97.51% 96.92 % 

88.76 % 

0.045 s NVIDIA GTX 580 (Python + OpenCL) 

Our Method 


95.17% 95.17% 

93.76% 

0.029s 

4 core @2.3 Ghz(C++) 

BL [21] 


95.65 % 94.47 % 

87.23 % 

0.02 s 

1 core @2.5 Ghz (Python) 

SPlane + BL [23] 

95.48 % 92.34 % 

79.79% 

2 s 

1 core @ 3.0 Ghz (C/C++) 


For lane departure warning system, optical flow computation 
result are shown in Fig. [7] Optical flow near to vehicles is 
used for estimating its possible horizontal velocity. 

V. Conclusion 

In this paper, a robust lane detection system is presented 
using steerable edge features and RANSAC polynomial 
fitting. We have got considerable accuracy for lane detection 
and warning system even in shadow and sunny road. This 


algorithm especially focus on enhancing safety in normal 
driving and for autonomous vehicles by keeping track of its 
proper lane, also addresses the problem of Indian road con¬ 
dition by defining new boundary detection method. In future, 
we will implement a probabilistic lane tracking system for 
reducing per frame processing cost. 
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